The effect of quantization on the FCIQMC sign problem 
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The sign problem in Full Configuration Interaction Quantum Monte Carlo (FCIQMC) without annihilation 
can be understood as an instability of the psi-particle population to the ground state of the matrix obtained 
by making all off-diagonal elements of the Hamiltonian negative. Such a matrix, and hence the sign problem, 
is basis dependent. In this paper we discuss the properties of a physically important basis choice: first versus 
second quantization. For a given choice of single-particle orbitals, we identify the conditions under which the 
fermion sign problem in the second quantized basis of antisymmetric Slater determinants is identical to the 
sign problem in the first quantized basis of unsymmetrized Hartree products. We also show that, when the 
two differ, the fermion sign problem is always less severe in the second quantized basis. This supports the 
idea that FCIQMC, even in the absence of annihilation, improves the sign problem relative to first quantized 
methods. Finally, we point out some theoretically interesting classes of Hamiltonians where first and second 
quantized sign problems differ, and others where they do not. 



I. INTRODUCTION 

Projector quantum Monte Carlo methods such as Dif- 
fusion Quantum Monte CarlcS (DMC) and Full Config- 
uration Interaction Quantum Monte CarkP (FCIQMC) 
generate a stochastic representation of the solution of 
the imaginary-time Schrodinger equation, d\ip)/dT — 
—H\il)}. As long as the starting state \ip(r = 0)) has a 
non-zero overlap with the ground state \ipo}> the solution 
\iP{t)} converges to |^>rj) as t oo, up to a normaliza- 
tion. In FCIQMC, the Hamiltonian is represented in a 
finite discrete basis, typically Slater determinants. The 
imaginary-time Schrodinger equation is thus expressed in 
the matrix formulation, 

^ = -£<i|(£-S/)|j> Cj (r), (1) 
j 

where |i) represents a many-particle basis function (e.g. a 
determinant), q(t) = (i|^(r)) is the component of \ip(r)) 
along |i), S is a parameter which can be adjusted to con- 
trol the normalization, and / is the identity operator. 
We define -By = (i\(H — S'^)|j) and assume that H has 
time- reversal symmetry, so that H 1} and thus ci(t) can 
be chosen to be real. 

In FCIQMC, an initial population of signed psi- 
particles or psips (not to be confused with the real par- 
ticles of the system) is distributed over the Hilbert space 
such that the expected value of the signed psip popula- 
tion on |i) is proportional to Ci(0). The psip distribution 
is then evolved in time using an algorithm which ensures 
that the expected value of the signed population on |i) 
remains proportional to q(t). In the t — > oo limit, the 
psip distribution provides a stochastic snapshot of the 
ground state wave functionP^ 



The amplitudes q(t) and q(t + At) of a solution to 
Eq. ([I]) are related by the formula 

Ci (r + Ar) =Y,(i\e- {R - sT)AT \j)cj(T), (2) 
j 

for which different projector QMC methods use dif- 
ferent approximations for the exponential. For in- 
stance, DMC in the continuum uses a Trotter approxi- 
mation to generate the transition matrix Udmc(R- R') = 
(R|e~ f AT e-^- s7 ) AT |R'), where f and V are the kinetic 
and potential energy operators, and R and R' are posi- 
tions in the 3-/V-dimensional space of particle coordinates. 
In FCIQMC, a first-order finite difference approximation 
is used instead: e _HAT ss I — HAr = Ufciqmc- If the 
product of the time step At and the largest eigenvalue 
B max of H is not too large, then the ground state of H 
is the same as the dominant eigenvector of U FCI q MC . 
Note that throughout this paper we use the term 'dom- 
inant' to mean the eigenvector with the largest eigen- 
value. Similarly, in Lattice Regularized DMC (LRDMC), 
where an upper bound on H is introduced by adding 
an artificial lattice^, one also uses the transition matrix 
Ulrdmc = I — HAr. In this paper, we focus primarily 
on the case of FCIQMC. However, by formulating our 
arguments in terms of the transition matrix U, most of 
our results are applicable to all projector QMC methods. 



II. GENERAL PROPERTIES OF THE SIGN PROBLEM 

FCIQMC is a stochastic algorithm for applying the real 
symmetric matrix Ufciqmc (which we call U from now 
on) to a population of psips. Because FCIQMC works 
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in a discrete basis, two psips of opposite sign occasion- 
ally end up on the same basis function, at which point 
they cancel out and can be removed from the simulation. 
When FCIQMC was initially proposed, it was observed 
that this process, known as 'annihilation,' is critical in 
order for the psip distribution to converge to the ground 
stated Two of us subsequently showecP that: 

1. In the absence of annihilation, the densities of pos- 
itive ({cj 1 "}) and negative ({cj"}) psips evolve ac- 
cording to coupled equations. The out-of-phase 
component, Cj — cj", evolves according to 

cf(r + At) - c7{t + At) 

= Y, U v[4(t)~c7(t)] (3) 
j 

and converges to the dominant eigenstate of U, i.e., 
the ground state of H. In contrast, the evolution 
of the in-phase component, cf + cj~, is governed by 
a different matrix U, the elements of which are the 
absolute values of the elements of U: 

£Aj = N- ( 4 ) 

2. The largest eigenvalue of U is always greater than 
or equal to the largest eigenvalue of U. Thus, in the 
absence of annihilation, both cj 1 " and cj" tend to the 
dominant eigenvector of U. The physical ground 
state can in principle be obtained by subtracting cj" 
from cf , but the difference is exponentially smaller 
than cj 1 " and cj" . In a real simulation using a finite 
number of psips, the difference is swamped by the 
statistical noise in cj^ and cj" ; this is the sign prob- 
lem in the FCIQMC method. The severity of the 
sign problem depends on the difference between the 
largest eigenvalues of U and U. 

For projector methods such as FCIQMC and LRDMC, 
which are based on a transition matrix of the form U_= 
I — HAt, we can talk instead about the properties of H, 
the matrix obtained by making all off-diagonal elements 
of H negative: 

H{j = — | If y | ; i/ii = Ha . (5) 

Since the diagonal elements of U are always positive for 
small enough At, the diagonals of U and U match. By 
construction, so do the diagonals of H and H. Thus, for 
small enough At, U = I — HAt, so the ground state of 
H is identical to the dominant eigenstate of U. 

III. COMPARISON OF FIRST AND SECOND 
QUANTIZED SIGN PROBLEMS 

The analysis of the sign problem in Ref. |3] did not 
assume anything about the choice of basis, and in par- 
ticular did not require that the basis be first quantized 



(unsymmetrized, as in DMC simulations™!!) or sec- 
ond quantized (symmetrized or antisymmetrized, as in 
FCIQMC simulations of bosonic or fermionic systems, 
respectively^). In this paper, we compare the sign prob- 
lems for many-fermion systems expressed in first and 
second quantized bases, answering two questions. First, 
when are the sign problems of first and second quantized 
algorithms different? Second, when they differ, which is 
better? 

In order to be clear about the basis in which a quantity 
is expressed, we shall use the subscripts F, D and P to 
indicate a first quantized basis of Hartree products, a sec- 
ond quantized basis of Slater determinants, and a second 
quantized basis of permanents, respectively. A quantity 
without any subscript is general and can be considered 
in any of the three bases. 

Let us consider a basis of Hartree products, {|i)}, for 
a system of N fermions and M single-particle basis func- 
tions, where |i) = 1^(1)^(2) • • • (j>i N (N)) and multiple 
occupancy of any single-particle basis function, <pj , is for- 
bidden. The vector index i defines the list of N single- 
particle basis functions appearing in a Hartree product 
and specifies the order in which those basis functions oc- 
cur. The first quantized Hamiltonian is formed by taking 
matrix elements of the Hamiltonian operator with respect 
to the M Pn Hartree products, so that each eigenstate of 
the Hamiltonian can be written as a linear combination of 
the form \tp) = Y]. Cj\i). However, physically meaningful 
many-fermion wave functions must be totally antisym- 
metric with respect to exchange of any two fermions and 
hence may also be expressed as linear combinations of 
Slater determinants. 

The fermionic second quantized basis is thus the set 
of M C N determinants {|A)}- We use the notation 
|i) € \Di) to indicate that the Hartree product |i) is a 
permutation of the orbitals in \D{). For |i) G \Di), \F>i) 
can be obtained from |i) using the antisymmetrization 
operator A, defined by 

■4^(1)^,(2). --^(N)) = 

4E(- 1 ) Cp I^cd( 1 )-"^wW>. (6) 
p 

where P labels permutations of the N orbitals and (p is 
the sign of the permutation. Then _4|i) = ss '^j^ \ Di), 

where the factor of ^/Wl ensures that |i) and re- 
main normalized. The order of the orbitals appearing in 
a determinant |A) = (JV!) 1 /^^ (l)<fe (2) • • ■ cj) lN (N)) 
affects only the overall sign. Hence, to uniquely specify 
each determinant, we insist that ii < i 2 < ■ ■ ■ < in ■ We 
utilize a similar notation for the (bosonic) basis of per- 
manents, {|-Pi)}, defined by \P{) = s/W.S\i), where S is 
the symmetrizer. 

To get a feel for how the sign problem could be worse in 
a first quantized formalism than in second quantized one, 
consider a first quantized psip on |i) that is connected by 
off-diagonal elements of U to |j) and |j'). If the orbitals 
in j and j' are permutations of one another, then |j) and 



|j') both appear in the expansion of the same determi- 
nant: |j'> e |Dj). After a single step of the FCIQMC 
algorithm, it is possible for the antisymmctrizer to map 
these two psips to with opposite signs, as illustrated 
in Fig. [I] If the amplitude of |V'( T )) on IA) is small, 
the cancellation of the two first quantized contributions 
needs to be very accurate to stochastically obtain the cor- 
rect amplitude. In practice, the small signal is swamped 
by statistical fluctuations in the first quantized psip pop- 
ulations and a sign problem results. FCIQMC in a de- 
terminant basis performs this cancellation automatically. 
Therefore, as we rigorously prove in Appendix[SJ the first 
and second quantized sign problems are identical if and 
only if the two first quantized psips always contribute 
with the same sign to the total weight on \Dj). This ar- 
gument also suggests that, if the sign problems differ, the 
second quantized algorithm will be better. 

To define the difference between sign problems more 
explicitly, we consider the ground state properties of U 
in a first and second quantized basis. In the first quan- 
tized basis, both \Jp and XJp commute with arbitrary 
permutations of the particle labels. Therefore, the domi- 
nant eigenstate \<pf) of Uf must transform according to 
an irreducible representation of the permutation group. 
Since all elements of Up are non- negative in the |i) ba- 
sis, it may be shown via a simple variational argument 
that all non-zero components (i|<^f) have the same sign, 
and hence that \<pf) has a non-zero overlap with the 
bosonic state \i^b) = J2i I' 1 )- As eigenvectors transform- 
ing according to different irreducible representations are 
orthogonal, it follows that \<Pf) must also be a bosonic 
state. Therefore, \<pf) may equally well be regarded as 
the dominant eigenvector of the matrix (Pi|U.F|Pj) ob- 
tained by evaluating the matrix elements of Up in the 
basis of permanents. 

Meanwhile, the second quantized algorithm is unsta- 
ble with respect to the dominant eigenstate of the matrix 
Uo with elements | (£)i|TJ_p |Z?j) | . Although the matrices 
(Pi|Ui?|Pj) and Ud have the same size - each containing 
(AH) 2 fewer elements than Up in a Hartree product ba- 
sis - they are not in general the same matrix. Whenever 
they differ, we prove in Appendix [X] that the dominant 
eigenvalue of Uu is smaller than the dominant eigen- 
value of (Pi|Uir|Pj); the second quantized sign problem 
is therefore less severe than the first quantized sign prob- 
lem. The sign problems in the first and second quantized 
bases are the same if and only if the two matrices are the 
same: 

(PilUiHPj) = (A|U D |A). (7) 

We also prove that this condition is equivalent to our 
previous conditions on the psip dynamics, as discussed 
above and illustrated in Fig. [TJ 

It is worth noting that in FCIQMC and LRDMC, 
where Up = I — Hp At, \<pf) is also the bosonic ground 
state of Hf. This state is not in general the same as the 
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FIG. 1. A single step of the FCIQMC algorithm, illustrating 
how the first and second quantized sign problems can dif- 
fer. (Top) In the first quantized algorithm, a psip on |i) may 
spawn children on two different Hartree products, |j) and |j'}, 
belonging to the same determinant: |j), £ \Dj). After anti- 
symmetrizing, the psips may contribute with opposite sign to 
the total weight on \D$). (Bottom) Performing the same step 
in the second quantized algorithm, the cancellation on \Dj) 
is automatically accounted for by the sign and magnitude of 
{D t \U\D s ). 



physical many-boson ground state, which is the lowest- 
energy totally-symmetric eigenstate of Hp- For LRDMC 
in real space, however, all off-diagonal elements of Uj? are 
already positive, so Up = Up, Hf = tip, and the in- 
stability is with respect to the physical bosonic ground 
state for this special case. 



IV. EXAMPLES FOR PHYSICAL HAMILTON I AIMS 

There are a number of physical situations in which 
the equivalence condition, Eq. Q, holds. The simplest 
is when the two-particle part of the Hamiltonian oper- 
ator is diagonal in the Hartree product basis, so that 
all off-diagonal matrix elements are single-particle in na- 
ture. Important such physical examples are the Hubbard 
model in real space and the LRDMC algorithm. For 
these Hamiltonians, the psips accumulate a (diagonal) 
weight according to the electronic potential and move 
(off-diagonally) according to the one-body kinetic opera- 
tor. To illustrate the relationship between first and sec- 
ond quantized psip populations in such a system, Fig. [2] 
plots their distributions for a simple problem involving 
two spinless fermions hopping between nearest-neighbor 
sites on a two-dimensional square lattice. As expected, 
the first and second quantized psip distributions are step- 
by-step identical, after antisymmetrization. 

A more general case where the sign problems are equiv- 
alent is when, in the space of determinants, all exchange 
integrals in diagonal matrix elements are non-negative 
and all off-diagonal matrix elements involve only a single 
integral, i.e., only a one-particle, Hartree, or exchange 
term. The restriction on diagonal exchange integrals is 
clearly necessary to make the diagonal elements of Eq. 
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Lowest eigenvalue (a.u. 

5.63133019 

5.26282782 

5.63133019 

5.34900281 

5.26282782 



TABLE I. Lowest eigenvalues of various matrices My related 
to the sign problem in the 3D uniform electron gasP Peri- 
odic boundary conditions were applied to a simulation cell of 
dimensions L x L x L containing four electrons at a density 
of r s = 1 a.u. The basis set consisted of all 38 plane waves 
with momentum less than 2n/L. The resulting determinant 
and permanent Hilbert spaces each contain 567 functions with 
M s = and momentum k = 0. The corresponding Hartree- 
product Hilbert space contains 13608 basis functions. 



FIG. 2. Comparison of first and second quantized 
psip distributions for an FCIQMC simulation of two 
spinless fermions interacting via the Hamiltonian H = 
— [ c l c j + c ] c i ~ n i n jj i where the sum is over nearest 

neighbors of a 4 x 4 square lattice with periodic boundary 
conditions. Images show the probability distributions of pos- 
itive (a,c) and negative (b,d) psips separately as functions 
of the imaginary time r. The propagation is performed 
analytically according to Eq. |5| using the approximation 
Ufciqmc = I — HAr with time step At — 0.1. While 
the positive and negative psip populations individually con- 
verge to the ground state of H {E = -7.41589748), their 
exponentially small difference (not shown) converges to the 
ground state of H (E = -5. 89171753); P Note that the upper 
right-hand triangles of comparable distributions (positive first 
quantized and positive second quantized, for example) match. 
The "missing" triangles can be reconstructed by expanding 
out the Slater determinants, after which the psip distribu- 
tions are step-by-step identical. A psip located at (Ri,Rj) 
represents the Hartree product \<f>i(l)cj>j(2)) or Slater deter- 
minant \f2A\4>i{l)4>j{2)) , where 4>i is a single-particle basis 
function at the lattice vertex (xi,yi) and Ri = Xi + 4j/i. 



i<j i<j 

(8) 

ui2\ij) - ^2(ij\ui 2 \ji), 
(9) 



matchPSl 

{p\u F \p) = j2(m 



(D\U D \D) = J2{i\h\i)+J2m 

i i<j 



where h is the one-particle interaction operator, m 12 is 
the two-particle interaction operator and 4>i,j are single- 
particle basis functions occupied in D and P. The 
Hubbard model in momentum space is an example of 
this second case: First, there are no exchange contribu- 
tions to the diagonal Hamiltonian matrix elements. Sec- 



ond, every member |j) of the set {|j)} of Hartree prod- 
ucts obtained by applying the momentum-space Hubbard 
Hamiltonian to an arbitrary Hartree product |i) differs 
from |i) by at most one spin- up orbital and one spin- 
down orbital. As no two such Hartree products in {|j)} 
can contain the same set of occupied orbitals, no two 
Hartree products in {|j)} can appear in the expansion of 
the same determinant. 

In the generic case, however, the first and second quan- 
tized sign problems are not identical. For instance, the 
matrix element of Hr> between two determinants D and 
-Dl"L, where D'i is obtained from D by replacing the 



a6' ab 

single-particle orbitals 
re-ordering, ij^HH 



and 4>b by <pi and c/>j without 



- (ij\ui 2 \ab) - (ij\u 12 \ba) 



(10) 



where ui 2 is the two-particle interaction operator, e.g., 
the Coulomb interaction ui 2 = l/|ir — r 2 \. The equiva- 
lent element of H^? in a permanent basis is 



(ij\u 12 \ab) - (ij\u 12 \ba) 



(11) 



In general, these two matrix elements will not be equiv- 
alent. As a concrete example, consider a gas of four 
electrons at a density of r s = 1 a.u. subject to periodic 
boundary conditions. Table |T] shows the ground state en- 
ergy eigenvalues of the matrices obtained when this sys- 
tem is studied using a basis of (antisymmetrized) product 
functions constructed from a set of 38 one-electron plane 
waves. The sign problem in a basis of determinants is 
less severe than that in a basis of Hartree products. 



V. CONCLUSIONS 

In summary, we have given two equivalent conditions 
for determining whether the first and second quantized 
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sign problems for a given system are the same. For situa- 
tions where the sign problems differ, we have shown that 
the second quantized algorithm is better. Thus, the use 
of an explicitly antisymmetrized basis can ameliorate the 
most fundamental problem faced by almost all fermion 
QMC methods: the sign problem. Indeed, our condi- 
tions show that this improvement will occur for nearly 
all problems involving QMC on realistic systems (atoms, 
molecules, solids, etc.). However, we have also seen that 
there are a number of lattice models of great interest to 
the condensed matter community, such as the Hubbard 
model, where second quantization has no effect on the 
sign problem. 

Finally, we note that although our arguments and 
proofs have been focused on the case of fermions, they 
can be readily extended to many-boson systems and used 
to show that working in a second quantized basis of per- 
manents is at least as good as working in a first quantized 
basis of Hartree products. 



Appendix A: Proof of equivalence conditions 

We will now show: a) that the conditions described 
in the main text uniquely characterize when the first and 
second quantized sign problems differ, and b) , that if they 
differ, the second quantized sign problem is less severe. 
We work with matrices formed from the operator U, such 
that the wave functions sampled at time steps n+1 and n 
are related by \ifj n +i) = U\ip n ), We also use the notation 
U Q to denote a matrix whose elements are the absolute 
values of those in U Q : 



(i|U Q |j) = |(i|U Q |j) 



(Al) 



where a € {F, D, P}. 

We begin by considering the conditions under which 
the first and second quantized FCIQMC algorithms have 
the same sign problem. As noted in Eq. Q in the main 
text, it is clear this will be the case if 



(PilU^Pj) = (A|U D |A) 



(A2) 



Expanding out the determinants and permanents, this 
can be rewritten 



An 



iG-Di 



j2(m)w\3)(j\Dj) 



i£D, 

je-Dj 



(A3) 



Since (j|A) = sgn(j\D$) / y/N\ , this becomes 



ieDi 



£(i|l>|j)sgn(i|A)sgn(j|A 



ieDi 

je-Dj 



(A4) 



By the triangle inequality, the left-hand side is greater 
than or equal to the right-hand side, with equality if and 



only if all terms within the absolute values on the right- 
hand side are of the same sign, SbiD,- In any example 
where the equality does hold, it follows that, for all i € A 
and j € -Dj , then either 



. (TO = 0, or 

• s DiDi = sgn(i|C/|j)sgn(i|A)sgn(j|£)j) 



(A5) 



where the sign s £>,£>. must be the same for all i € A and 
j £ Dj. If we consider two distinct FQ basis elements 
€ Dj, we deduce that either 

. (i\U\j) =0 or 

. (i\U\j f ) = or (A6) 
. sgn(j|A)sgn(i|C/|j) = sgn(j'|A)sgn(i|L7|j') . 

These are precisely the conditions we assumed were met 
by the first quantized psip distribution in the main text. 



Since the conditions in Eq. ( A6 1 are equivalent to those 
in Eq. (A2), it follow that if Eq. (A6) holds, then the first 
and second quantized sign problems are identical. We now 
prove the converse, that if the conditions in Eq. (A6) are 
not met, then the sign problem in a second quantized basis 
is less severe than the sign problem in a first quantized 
basis. Taken together, these two statements imply that 
the first and second sign problems are equivalent if and 



only if the conditions in Eq. (A6) are met. 

Let Ypd) be the eigenstate of Ud with the largest 
eigenvalue tjj. Construct the (normalized) FQ state \<pf) 
such that 



1 



W<Pf) 



(A7) 



for all |i) € |A}- Since Ud is a non-negative real sym- 
metric matrix, all amplitudes (A|¥>d) (and thus (i\ifp)) 
have the same sign and may be chosen real and positive. 

Now consider the expectation value t' F of the matrix 
U p in the state \<Pf) : 

t' F = (^fIUfI^f) = X>Hi><i|UF|j}<j|VF) . (A8) 



By definition <i|U F |j) = (i\U\j) 



Hence 



JV! 



$d)(Dj\<pb) (TO 



Nl 



Di,D, 



where, in the last step, we break the sums over i and j 
into sums over determinants A and A an d sums over 
the Hartree products contained in those determinants. 
From this point onward, assume that the conditions 



in Eq. (A6| are not met. Then there must exist some 



G 



j, j' £ Dj such that 
. ± and 

• (i|C/|j') ^ and (AlO) 
. sgn(j|£) j ) S gn(i|L>|j> ^ sgn(j'|£) j > S gn(i|[/|j'> . 

Consider the term 



E 



(All) 



appearing on the right-hand side of Eq. ( A9 1 . Since 
(j|-Dj) 7^ 0, this summation is equal to 



E |(i|t>|j)sgn(j|^j> 



(A12) 



Eq. (AlO I tells us that the signs of the j and j' contribu- 



tions to this summation differ before the absolute value 
is taken. Hence, by the triangle inequality, 



E Wd>Wd) e 



-Di.-Di 



iG-Di 



Noting that 



E<i|£|j)sgn(j|-D 

(A13) 



E |j>sgn(j|^j) - VM E |j>(j|A) = ^IA> 



we have 



EvTOsgn<j|A) 



(A14) 



= VM(i|c/|£)j) 

= VM(i|C/.4|A) 

= T/m{i\Mj\D s ) 

= (A|^|^j)sgn(i|A), (A15) 



which allows us to rewrite Eq. ( A13 1 in terms of deter- 
minants 



1 'f > M E (Di\(pD)(D0 D ) E |(A|C/|A>sgn(i|A 

' D U D 3 ieD t 

(A16) 

The sum over i £ A then cancels the 1/iV! prefactor to 
give 



E(AI^XAI^) (AI&IA 



= E(A|^d)(AI^)(A|Ud|A> =*d.(A17) 

Therefore, by the variational principle, the largest eigen- 
value if of is greater than the largest eigenvalue tp 

0f Ul3. 

In conclusion, we have shown that tp = tp, if and only 



if the conditions in Eq. (A6) hold. If they do not hold, 
then tp > tp,. The second quantized sign problem is 
therefore less severe than the first quantized sign problem 
unless the conditions in Eq. (A6) are satisfied. Finally, 



we reiterate that, as long as the largest eigenvalues of 
H and H are finite, their ground states are the same 
as the dominant eigenstates of U = I — HAr and U = 
I HAt, respectively, in the limit At —> 0. Therefore, for 
FCIQMC and LRDMC, the statements in this appendix 
can be recast in terms of ground state properties of the 
Hamiltonian matrix. 
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